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^Michigan Department of Educat 



FOREtfORD 



The sta^ o£ the Michigan Department of Education is pleased 
to be able to respond to the in5A.-MEA <iontracted study on the 
Michigan accotmtability system* 

We have attenq^ted, in responding to the report and the nine 
xeconia6ndationa, to provide as objective a respcmse as is 
possible* It is interesting to note/ of the nine recooinen*- 
dations made by the Panel,, six of them have the full support 
of the staJf , and appropriate modifications will be made 
consistent with Yjiose six reconinend&tion6« 

The staf does not agree with three of the recoonendations 
and hopes that future discussions will resolve these three 
differences of opinion* ' 

^ J ^ 

Finally, as Superintendent of Public Instruction, I am 
pleased that* the National Education Association joined with 
the Michigan Education Association in financing this study. 
In effect, the studf has done much to help us focus attention 
and understanding on what has become one of the crucial issues 
in public education in these Ilnited States — the issue of 
educational accpuntabil ity^ 
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A RESPONSE TO THE REPORT -AN ASSESSMENT OF 
vTHE MICHIGAN ACCOUNTABILITY SYSTEM' 



Introduction 

On April 12, 1974, tepresentatives .of the Michigan Education 
Association (MEA) and the National Education Association (NEA) held a. press 
conference in Lansing, Michigan. The purpose of thia conference was to 
announce the release of a special report entitled An Assessment of the 
Michigan Accountability System vhich was prepared by a committee composed 
of brs. Ernest House, Wendell Rivers, and Daniel Stuff lebeam under contract 
jriLth the MEA and NEA. r 'r 

As originally conceived .by the MEA and NEA, the three-man panel wAs 
to "evaluate the educational soundness and utility tor Michigan of the 
Michigan Accoudtability Model with a particular focus on the assessment 
component The report was to be the sole responsibility af the panel, and 
there was no commitment on the part of the MEA or NEA to'dadorse the findings 
of the panel. • • ^ . 

' Data were gathered for this investigation by reviewing publications 
of the Michigan Department of Education (MDE) '^and interviewing various 
educators, citizens, MDE staff members, and representatives of various 
organizations. These efforts welre sprea^oVer a period of time from approxi- 
mate^ty December 15, 1973^ to March 1, 1974, or two and one-half inonths. 



1 - ' ' 

Ernest House, Wendell Rivers, and Daniel Stuff lebeam. An Assessmgtnt 

of The Michigan Accountability System <a reporfc^vailable from the Michiga 

Education Association, East Lansing, Michigan: march, 1974), see APPENDIX* 

2 

/'Assessment of Mffehigan's Accountability System," Teacher's Voice 
(East Landing, Michigan: Michigan Education Association, April 22, 1974, 
supplement), p. 12* 



Thus /it vould) on the surface^ appear that the HEA and N^A 
desired to conduct an .unbiased and objective evaluation of Michigan's 
educational accountability program — a study which would produce observations 
and judgments without inaccuracies or emotional exhortations. To some 
degreisf the panel succeeded in meeting this expectation; ^however, (1) the 
report does contain inaccuracies, (2) it does not seem to be totally unbiased 
and (3) it appears to be based on somewhat unrigorous and hurriedly-gathered 
information. 

The Department recognizes the complexity of the task which faced the 
three-man panel. The amount of information available on the topic of educa- 
tional accountability in Michigan is enormous and reaching objective 
conclusions about the topic is difficulty at best. The panel undoubtedly did 
its best under these circumstances and should be recognized for its efforts. 

Nevertheless, the position of the Michigan Department of Education 
is that through criticism comes growth and the Department itself must be 
accountable if it is to encourage others to be accountable. The Department's 
approach, therefdre, is to seriously consider each charge and each recommen- 
dation of the panel tu dete r mine: — 1) if lue panel 'j 3 conclusions are based 
on inaccurate or Insufficient information, 2) if the panel's conclusions 

simply reflect a difference in philosophy of education^ or 3) if the panel's 

• *' * 

conclusions have value for improving the programs, of the Department. 

This report will be organized parallel to the panel's doctmient. 

E^ch major section of their document will be analyzed and comments offered 

to clarify the issues involved. More detailed responses to each of the panel' 

recommendations is attached as an APPENDIX to/ this paper. 
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/ State Level' Leadership 

It is. gratifying to note that the panel found the staff of the 

Michigan Departnient of Education to be courageous, have good motives, and 

3 ' . • • ' . 

be highly skilled. Department leaders fiaVe always atpAipted to maintain 

a high level of staff quality and feel that they have been very successful 

in ass^bling a staff which has enthusiasm and a willingness to venture . ^ 

into the unknown. - • . ^ 

The panel evidently feels that accountability has been thrust on 

Michigan education with too much speed and without an adequate rationale. 

♦ 

. The staff recognizes that accountability is a complex issue and that there 
is little* outside information available beyond the Michigan experience to 
guide the development of accountability efforts. However, while -the panel 
evidently fears this sitiiatlon and would wait until someone else invents 
the guidelines, the*flDDE approach haq been to challenge the unknown and 
develop knowledge where none existed. 

As an interesting side note, the panel claims "researchers have not 

' II-) 

produced tested standards and procedures for state accountability systems. 

This being the case, how can the panef be so presumptuous as to ejstablish 

itself as the best judge of the quality of the Department efforts? For 

that matter^ what standards were used by the ^panel to judge the current 

accountability program in Michigan? Were the standards reasonable? Were 

they acceptable to a group such as the American Educational Research Association? 



p. 2. 
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House, et al . An Assessment of the Michigan Accountability System , 
^Ibid., p. 3. ^Ihid . 
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The Six-step Accountability Model 

It is gratifying to see that the panel repoift is favorable toward 
the Michigan 5tate Foard of Education's six-step accountability model. ^ 
Evidently, t!he panel sees the model for what it is— simply a series of . ^ 
steps ) a particular process to be exact, designed to lead to better and 

more careful educational planning* 

»»» • I ' 

The Department recognizes that difficulties arise when these ^ 

simple six steps are implemented at the local level, and, furthermore, the 

more specific in nature *the step is, the more complex becomes the decisions 

which have to be made.. The Department makes every effort to reduce those 

factors which will be "counter productive" and "inconsistent with the 

model," to use 'the panel's words, but as with \ny innovation as complex as 

this one, apparent problems do arise/ and the Department does not wish to 

claim that such problems have not occurred . The Department intends to continue 

doing all it* can do to identify and correct these problems as they arise. 

Step 1; The Common Goal^ . The panel reports that the Common Goals 
of Michigan Education are "broad and generally non-controversial" but that 
the goals are unclear and not subject to an oti^oing review. 

The Department agrees that the goals are broad and may, to some, 
appear^o be unclear. However, goals are nop designed to be highly specific 
and detailed. By their very nature they are supposed to indicate general 
direction only. They are intended t^^e long range and subject to change 
only after sufficient evidence warrants such changes. 



^Ibid .^PP. 3-4. 
^Ibid., pp. 4-5." 



• The panel suggests the goals be periodically reviewed and updated 

but gives no Indication of its recommended time-line for such review. The 

Department agrees that such reviews are necessary in the long term ^-^nd 

» — > * ... • ' ( * 

such a review of .the twenty-two goals of Michigan education will be* 

established.' Indeed, the Superintendent af Public Instruction will request 

the Council on Elementary and Secondary Education to annually review the 

educational goals in light of ' new information, * " 

Step 2; The Objectives . The panel report indicates that the 

Department has not articulated performance objectives in all goal areas but 

8 

has primarily 'done work in the cognitive areas. This is basically true but 
is misleading . The Department has done some preliminary work in developing 
performance "indicators" in all of the twenty-two goal areas through the 
ESEA, Title III needs assessment report. The Department has also attempted 
the development of affective domain objectives for grades K-9 and has a 
commission working ^n it now; however, as might be expected the development 
of such objectives is difficult and subject to considerable debate. Objectives 
in the psychomotor and affective domain areas have been developed f or the 
preprimary levels and will be incorporate^ in the first grade assessment 
during 1974-75. Psychomotor objectives for grades K-9 have also been developed. 

J The panel report Implies that the Department has developecl only 23 
and 35 fdurth grade reading and mathematics objectives, respectively, and 

9 

23 and 45 seventh grade reading and mathematics objectives, respectively. 

' • 
This is not true . The numbers cited reflect the objectives included in the 



Ibid., p. 5. 
^Ibid., p. 5. 
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1973-74 Michigan Educational AiSsessment Program tefsts. The Department . 
widely advertised in its publications and numerous workshops that the 

assessment^ program would only measure a subset of the performance objectives* 

<• 

The panel , claims that the objectives iare not based on a consensus " 

of Michigan teachers but are instead based in part on practical considerations 

such as test length.^^ Practical considerations, of course, did play a 

part in determining the' objectives to be assessed in 1973-74 but such' 

considerations did not restrict the development of the total set of objectives. 

Even so, the objectives which, were measured were selected on the basis of , 

highest priority within the given limits of available test time. Only two 

or three of these items were subsequently removed when the pilot test 

revealed some questions abo^t their reliability* 

More Importantly, the panel states that "the objectives so far 

« 11 

developed do not 'represent a consensus of educators." Whether or not this 
is true depends upon how one interprets the word "consensus." The Department 
admits that it did not poll each of the state's 100,-00^ professional 
teachers regarding the performance objectives and, to that extent, did not 
produce a consensus. However, the performance objectives were not developed 
in the dark under a bushel^ basket but were, instead, developed with the 
assistance of hundreds of teachers, curriculum specialists, and adminis- 
trators . Each Department instructional specialist was responsible for 
subjecting the objectives to open scrutiny by other educators, and each 
.can docimient the people to whom set^ of draft objectives were sent for 
review. Additionally, the objectives were evaluated in eleven elementary" 
schools and seven secondary schools as to their reasonableness. 



■"■^Ibid., p. 6. ■'■■'■Ibid. 



if 



^ -7- 



Furthermore, each set of objectives was reviewed and approved by, 
a panel of educators, citizens, and students, and by the Council on Elementary 
and ^econdary Education before being recommended to the State Board of 
Education. Even so, the Department recognizes that the performance 
objectives should not b*e considered petfected at this point but subject to 
further review and revision. In fact, the Department is actively encouraging 
local educators to analyze the objectives and share their comments with the 
Department's instructional specialists. Additionally, contracts have been 
issued to the Michigan Council of Teachers of Mathematics and to the Michigan 
Reading Association to review the results of the 1973-74 educational 
assessment and the original performance objectives and recommend changes 
which might be used to Improve the quality of the objectives and the assess- 
ment program . 

V, The panel also criticizes the Department for its use of the term 
"mintoal performance objectives" and claims that the objectives as developed 
,do not 'represent a "minimal" quality. The panel cites California Test 

Bureau and implies that failure of CTB"s "sensitivity td instruction index" 

, 12 ' 

in some ways confirms the lack of validity of the objectives. 

The Department agrees that there is confusio^ over the term "minimal." 
On .the one hand, a minimal objective might be thought of as reflecting only 
what students can do now as opposed to what is desirable for students to be able 
to do without regard to whether or not they can do it now . The former- 
definition assumes the status quo to be the criterion of success for an 

objective ^whereas the latter definition encourages one to establish a 
criterion independently and a pridri . 



^^Ibid. , pp. 6-7. (See p. 13 for further discussion at this issue.) 
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Unfortunately, many citizens and educators hold the expectation 

that the Department fully expected an<J, 'in fact, knew that the minimal ' 

objectives would ^e attained by almost all students during the 1973-74""^ 

assessment. . This was, however, not the case. The Department , expected 

the objectives not to be attained by most of the students la^t fall but 

to be worthy of attainment as soon«as possible (assuming the objectives were 

* • • * • 

not changed In the review process) as a regwlt of Improved Instruction. 

The whole Issue reduces , Itself to one of whether or not there 
exist? a common core of objectives that transcend local district boundaries 
and for which all schools 'should be responsible for heli)lng stiidejits attain. 
The Department's position is that these objectives do In fact exist, that 
they are Identifiable -through a rational process, and that the effort Is 
worthwhile . The Department believes that If no common core of^bjectives 
exists, the movement of families from one location to another Is seriously ' 
jeopardized. In fact, the process of changing classrpdffi^ In a given school 
or building would 'be subject to challenge I Evidently « the panel simply does 
hot share the Depattment's attitude . ' ^ * 

As a related Issue, the panel questions making available a list of 

^ 

these objectives^ to parent^ in the ^<5rm-of a '^arenb^ handbook." If one 
assumes that these objectives can be identified and have been miade available 
to each local school district, fehere is no reason wliy they should not be 
communicated- to parents and citizens. However, the Department recognizes 
that snoh jk booklet of objectives for parents would be controversial, so 
steps are being taken to determine the reaction of parents, citizens, *and 
educators in selected districts to th^ desirability of thJLs^ process.^ 'This 



f ^Ibid .>, p. 8. 
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. . . .. . . -'1 . . • .. . 

process, it should be mentibned. Is intended to, involve parents and 

citizens in the educational procesq^ wWLch is clearly specified in *the 

- . • " - . • . 'I 

, * Common Goals :of Michigan Edudation , \k . ^ 

- ^ ^ Step 3; The Assessment Componj^t , . Because the panel devoted 

, * ' ' " • • • f . ' ' ' * 

extensive space tea critique .of the Mchigan Educational Assessment' 

Program^ the issues will be addressed In a later section ,of this docume])t> 

Step 4; Analysis of Delivery System ^ The panel evidently feels 
* * . . * ^ . ' • ' %. 

that the Department is to be coiamended: in its efforts tp identify workable, 
alternative delivery systems but objects, yigorously to one specific state 
.^ffort, the so-call^d/Chapter 3 Program^ Since an entire section was ^ 
» devoted to this one Program, it. will be discussed in a later section of 

. ,;this jJoctiitoent* - - ' . 

\i Step 5; Developing Local Evaluatioil Capabilities > The panel made 

r the observation that local scho^ol district personnel need assistance in 

developing evaluation capabilities The Department agrees that there is 
sucti a need and^ is committed to determining , the best approaches to assist 

. . , I in this endeavor- * . : ^ 

During the past four years, the Department's evaluation activitl^ 
have expanded considerably. , Currently, seven programs of the Department are 
4>elng evaluated. These evaluation activities cover nearly 1,100 projects in 

^ over 500 school districts. Ad^itidnaily, technical assistande in evaluation 

is .available to state and local educators in t^he form of consultation and 
workshops. Annually, 30 or more workshops are conducted throughout the 
state for local education agency staff. 



•"•^Ibld., pp. ^-10. •'• ^Ibld .^ p. 10. 
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The staff is currently conducting a survey of local and Inter- 
loediate school district resources and capa|^ilities in evaluation. Based 
oa the^ results of this survey, which will be made public later this-^year, 
. more adequate services will be plaimed and designi^d to provide expansion 
of , activities ajssociated with step five of the accountability modej. This 
expansion will proceed consistent with irhe interest, capabilities, and 
needs of local and inten^ediate school districts. - , 

Step 6; Use of Accountability Jata for Decision-Making . The panel 

states its st^picion that few decisions or recommendations are being made 

. . ^ 16 

on the basis of the results of the educational accountability program. This 

is, of course, sheer conjee tur.e on 'their part because they did not attempt 

a study to reveal tfie extent to \fh±ch decisions are being affected either 

by the assessment component or the over^l dccountatiHty program. 

Department staff know of many instances where the Department's 
accountability^ efforts over the last five years haVe affected educational 
decisions at the legislative, judicial, state agency, and local school 
district levels. The primary effect has beeit on the state agency and local 
.school districts because they make educational' decisions on a daily basis. 

However, the Department recognizes the need for addiltional data on 
thiis point anirwlll begia conducting studies jwhich would documept the Impact 
*of the state assessment program on local agenc^ decisions-making. 

The remainder of this report focuses on two of the unique programs* 
underway^in Michigan which were criticized by the MEA/NEA panel. 

s * 

State A ssessment ' " . - , 

1 ' 

Th^ panel devoted considerable attention to the Michigan Educational 



■"•^Ibid., -p. 11. 
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Aqs^smeut Program. This^ perhaps, reflects the fact that this Program** 
has heen somewhat controversial~for various "reasons^since It began in 
January, 1970. This section of their report had the. greatest potential of 
Improving the accotmtability effort in Michigan, but it, unfortunately, fell 
short of %ts potential. The discussion presented by the authors is confused 
on certain errors of fact and muddled, by emotiSnal atguments which will be 
clarified in the following pages* 

The authors cite three reasons for the Department's move frcftn the 
normative tests used from 1970-73 to the new objectlve-rreferenced tests. 

1) unfair comparisons between school districts,, 

2) tests discrlmlxiated against ijilnority youth, and 

• * 

3) • the t^sts did not meisur|^what Ulchlgan teachers were . 

teaching In the schools.* 

The panel further states that the objective-referenced tests have been well 
received, because the Program correct^ these thifee. faults . * * 

As a matter of fact, school district comparisons (fait or unfair) 
can still be made through the use of objective-referenced tests. The purpose 
of a needs assessment program Is to identify areas of greatest educational 
: need and, thus, by definition Implies a comcfarlson. What is -not Implied, 
however, is a comparison of efficiency of school programs. Comparisons 
under the normative ot the objective-referenced tests are, therefore, not 

inherent ly^< unfair, inadequat^^ or incorrect.. Such comparisons become unfair 

' * ' ^ ■ ! 

only when people assimie that the needs assessment program is a report card 

rariking or evaliiation of the state's schools . 

It is probably true tha^ the noroiative assessment tests discriminated 

between nonachievers (who, coincident ally, are most likely to be from'lower 



^^Ibid., p. It; 
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socioeconomic clashes) and achievers but so do the objective-referenced 

» 

tests. Indeed > the very purpose of any achievement test is to reveal 

(to, discriminate) differences in educational attainment between students * 

The issue, here, is* whether or not minority children should be 

expected 'to always achieve less ai\d, therefore, be tested with a separate 

test» The Department mak^s the assumption that; there is no reason why mostf 

children cannot achieve certain' minimal skills and, therefore, it is , 

appropriate to determine if such skills are being achieved, and,. if not, 

the reasons why. Td^ design a minority group test would certainly be possible 

but the question is, "Should it be done?" The staff say hoi 

• As ^ related issue^ it should be made clear -tha^ the 1973-74 fourth 

and seventh grade assessment tests were piloted li^ the larg g^cit ies of 

Jackson and Pontiac and, in all eight regions of Detroit. Minority group * 

students, if ^y thing, were over-represented In developmental phases of 

18 

the prdject contrary to' what the panel report indicates. , . 

The third point raised by the panel is probably the most frequently 
cited r^son why objective-referenced tests were developed. However, it, 
too, is close tOgb^eing a moot issue because *there is no reason why normative 
tests cannot reflect Michigan's curriculum. There is evidence to suggest 
that the curriculum o| schools nationwide is very similar and that any 
achievement test used in the schools could be used widely. Indeed, this has 
been ^major critiqism urban school districts have had of textbook pa|)lishers. 
. The real reasons why* the Department moved toward objective- \^ 
. referenced tepts. are that 1) the accountability model specifically calls '^or 



^ ^IbiU . . p. 14, 



such objective-referenced assessment, 2) the develdpment of perfbroance 
objectives and tests tied directly to them is a useful process for 
educators because *it clarifies instructional intentions:, and 3) the 
objective-referenced test data are much more specific and, hence, useful to 
teachers In better responding to Individual student, needs. 

♦ 

The Tests > The panel compliments Ihe Depattment on the ^reliability 
of its new objective-referenced tests but questions the validity, again. 



and cites the failure of CTB's "sengiitivity index" as reason for questionning 

19 ^ * i ^ 

N.the validity/^ . \ 

• ' \ * 

The Department viewed CTB's sensitivity to instruction index as 

* - ^ -n^ . 

experimental. The index is not widely used or endorsed by other reputable 

test publishers. ^CTB had not experienced dtam^tic an4 repeated- success 

.with the index, but the Department felt the method Was worth trying in the 

- i ' * 

developmental phases of the project in addition to^ other, more conventional 
methods . 

In practice, the /index did not vzork v/ell'for a variety of reasons, 
. some of which were specific to the Michigan project. Failure of this index 
does no^ necessarily indicate any inadeqtiaqy of the index for other situations 
nor is it evidence of Weakness in the testi The sensitivity to instruction 
data were- not adver'se but inconclusive, and, for that reason, not used. 

^ The report entitled •'Development of Test Items and Instruments in 
Reading and Mathematics for the 1973-74 ^JHchlgari Educational Assessment 
Program'' discusses eight different types of information considered in 



19 
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1 * 20 

selecting items and objectlyes for the assesdment tests. While the 

report was provided to the p^nel, this information unfortunately seems 

to have escaped their, considcaration. .^^^^ 

Involvem^t of Teachers in Developing Tests and Objectives * The 

panel discussion of. this point ^Ls totally* without merit. First, it aliould 

be made clear* that thirteai paneUs (not one) were involved in the review 

of the draft i)erformance objecti^^s after preparation by various referent 

groups. There were thirteen such panels each with teachers as members. 

There were nine referent groups eacl^ composed of thirty people. Teachers, 

levels K-^university, dominated the rlpferent groups r" Additionally, hundreds, 

if not thousands, of- educators reacted to' th^ draft objectives before the 

State Board of Education approved them^ 

Secondly, the reference to a la^k o£ significant involvement on the 

part of the reading panel is out-of -place in that it refers to a panel used 

» • ' \ ' • 

to improve items for an older normative test and not the newer objective- 

• ' • * \' * 

* * ' \ . « 

referenced tests. !foreover, the reference\to ^his particular reading panel 

cites two- local educators who, in the past, \ have led opposition to the 

assessment program and, thus, are not exaptly unbiased , observers. 

As a third point, it should be mentiqned that 'the Michigan Education 

Association was invited to nominate a representative to serve^^on the 

>- . ' I * 

flichigan Educational Assessment Program advisofy council when it was be£ng 

formed in the summer af 1572. , However, the MEA ,did not respond until after 



' the council members were selected. 
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Michigan Department of Education, Deveblopment of Teat 
:s in Reading and Mathematics fctf the l|p73-74 Michigan 



Items and 
Michigan Educational 



Assessment Prdgram (Lansing, Michigan: Mlchig£in, ]()epartment of Education, 
1974), pp. X9-26. , . 
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House, etal, Ai ^ Assessment of the MlchtLgaa Accountability System, 



pp* 13-14. 
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Cost of Every Pupil Testing , The panel report leads the reader to 
believe that the ' assessment program Is going to be expanded to other grade 
levels and other subject areas vhlch Is t3^ue > However, the panel t|ien 

launches Into a discussion of the gigantic cost associated- with such an 

'22 ^ ^ 

expansion. 



Unfortunately, the panel eyldently^ld not read the report "Grades 
to Be Tested" or the proposed long r'ange plan for the state assessment 
program. The .latter document clearly discusses the problems associated 
with such unl^lmlted expansloia of the assessment program. The plans Include 
the use of matrix sampling on a statewide basis and the use of every pupil , 
testing for only a small core of objectives as Is presently done* It should 
also be mentioned that the Department's long range plan Is being developei^ 
with consultation from Dr. Frank Womer, University of Michigan, who Is a 

2i 

nationally known expert on testing and who was cited In the panel report* 

« 

Domain Limitations of Present Instruments * The panel report accuseij 

the Department of utilizing .assessment Instruments which are lit^ted In 
24 

scope* Pjjesumably^ the panel objects to the testing of reading and mathe- 
ma tics skill objectives »alone and would wish to Include psychomotor and 
affective assessment* The Department staff would agree ! 

Th^ Department recognizes that the present testing domain Is restricted 
but it seemed only reasonable to test reading and mathen^ktlcs flrst^ because 
they £ire basic learning areas* The Department did not by Its actons Intend 
to si^ggest that schools should only emphasize reading and mathematics; 
''however, tlie department feels that student success in these two areas Is 
ba^lc, a1}sdlutely necessarj^, and Sa^lly measurable* Local districts have 



^ ^Ibld *, pp* 14-15* ^^Ibid*,.p* 7. ^^Ibid*, p* 16* 



been and should continue to be free to supplement the state assessment tests 
to cover any other domains of interest* The State Board of fiducation will 

4 

continue ta encourage local agencies to move in this direction* 

Need for Locally Developed Objectives > The panel makes a strong 
plea for locally developed objectives and the need to preserve local autonomy 
The Department agrees that learner performance objectives should be developed 
in ever^ locaJ, school district to supplement the state minimal objectives > 
-However.9 the Department feels that theJe is indeed a core set of minimal , 
objectives which transcend local boundaries and that these objectives should 
be measured through a statewide assessment program. 

^ Cleariy, this issue^is simply one of different philosophies between* 
the panel and ^he Department. The Department position is that people today 
are not place-bound and do not spend their lives in relative isolation. 
Instead, people. ate cosmopolitan — they are mobile — they move from city to 
suburb to city a^iri. These factors plus the use of nationally produced 
textbooks and tfeachers educated, at relatively similar higher education 
Institutions jto a comnron set of putcomes for at least a portion of 

the, country's educational programs. The panel evidently belieyes this is 
nofc ^Hfe' case— ^that each Ibcal district is free to operate conjpletely as 
it wishes without regard for the fact that nearly one-^fifth of all American _ 
families move. from one location to another annuSijLly. 

As' a last point, .there may bfe cases of 'principals being, preissured 
to raise scores, or teachers bed^ threatened by low scores, or cheating 
on the tests. But, the lextent^ to which this is happening is a matter of ' 



25 ^ "X* 
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conjectttre, not fact . If educators are finding that they have not been 
successfully teaching students the minimal skills they need, the Department 
hopes that Michigan educators will <jhange their present methodologies. How- 
ever, this in no way justifies cheating on the tests or o^therwise abusing 
the assessment program's ability to provide usable and helpful information 
if, indeed, this is happening. 

Publication of Test Scores . The panel membilrs quite accurately point 

to the publication of test results as a sensitive issue and one which has 

26 " ' 
been controversial. Examples of inaccuracies of interpretation are easy 

to fini and are quite often used as justification for not releasing such 
data. ^ 

Howevebr, this issue is not simple to dismiss.* Pressure from legis- 
lators for assessment d^ta, advice of the Attorney General's office, and 
district assessment rankings required by the original "Section 3" requirements 
all combined to motivate the State Board to authorize the publication of ^ 
assessment scores. In addition, not all local districts hav^ had problems 
with press coverage ^and haye, .in fact, been able to work quite closely with 
the press tp accur^lfeJLy report data. Finally, it is hoped school people will 
not, overeatimate th€? influence of mass media in swaying people against the 
^sihools with a single article listing low assessment scores. Local educators 
who are able to identify thelr^ critical audiences and provide proper, objec- 
t;ive interpretations of the data before any press coverage takes place are 
usually not affected % .Inaccurate reporting if it should happen. 

The basic issue here is whether or not the educational community is 
willing to. share data with their publl^cs whether or not it makes them "iook 
good." ^ 



^ ^Ibid ., pp. 17-18. 
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Teacher Evaluation > The' panel members Indicate their fear that 
teachers will be unfairly evaluated by the use of assessment tests — 
presiima'bly, this possibility is heightened because of the availability of 
classroom data during the 1973-74 assessm^t. This fear is well-founded 
in that it is a possibility. However, the sSpartment knnws of no Incident 
in which this has happened in Michigan. 

Teacher and administrator effectiveness should be evalxxated >ut 

such evaluations should not be administered in a threatening manner. 

Specific evaluation procedures are a local education agency responsibility 

and are not defined by the Department; 

Evidently, the pai\i?l believes that achievement test data have no ^ ^ 

28 

place in teacher evaluations under any circumstances. The Department 

agrees, that such data should not be the sole criterion for releasing a 

teacher or administrator, but it would be unwise to say4that it' could not . 

« 

become a component of suieh a system. Student learning is the primary 
objective of schools and measures of student growth under the tutelage 
of a teiacher may very well be useful as a part of teacher evalu^^^lpns . 
However, it is, incumbent upon the Department, the professlbn, school districts, 
an4 colleges to develop in-service programs which will provide assistance 
•to the . teather when evaluations identify- ineffectiveness. - ' . * 

Value of the Assessment Program for Various Audiences . The panel 
i:eport indicates that the educational assessment program Is of little 
value^to any major group and that the "posture of nonsupport is- widespread 
throughout the Michigan education community." Unfortunately, the panel 
presents no data to support such a claim. 



^^Ibid., pp. 18-^19. ^^Ibid., p. 18. ^^Ibid., p. 21. 
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The Department agrees that there Is a ladkof enthusiasm within 
some parts j)f the education coimnunlty but the extent of this attitude is 
not now known. Both the MEA and the Department are conducting surveys of 
teachers and of citizens to determine support for educational accountability 
and for the assessment program. These data will be available by mid-May, 
1974, and should provide useful information in this regard. * 

The feedback received by Department personnel during the current 
school year is that local educators* have become more positive toward the 
asse.ssment program because of tiie* objective-referenced tests. Moreover, 
local administrators and teachers are using the dat^ 'to Improve education 
in their districts. 't^. , ' 

The panel failed to mention the Department's increased efforts 

in the dissemination and utilization area. Department staff have been 

f 

concerned about a lack of understanding and use of assessment data and 

>\ 

have tried some new approaches ^to, dissemination. There are some data to 
Indicate that these efforts hav^ been worthwhile and effectived Additional 
suggestions by the panel i^pmbers would have bee6 quite helpful. 

Chapter 3 Program 

The panel devoted a separate section of their report to an 
attack on Michigan's compensatory education program. In large part, the 
panel and the Department simply do not seem to agree on thfe best way to 
conduct compensatory education programs. More significantly, the panel 
report is plagued with inaccuracies in its treatment of the Chapter 3 
prpgram. 

The panel members compliment the Department for its willingne^ 
to devote compensatory funds — in addition to federal funds — to combat 



< frA Survey of Views Concerning Michigan's 4th Grade Assessment Program^ 
1973-74^ Michigan Education Association - 74-R-26^ ^ 
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educational deficiencies and hope that such funds will be continued. 
However, the panel finds the evaluation fequii^ements of .the Chapter 3 
program IsamenSely distasteful. \ * , 

To clarify the panel's analysis of the. Chapter 3 program. It 
will be useful to cite each of several points made by the panel, and to 
react to each. 

Item: "Students are tested to determine whether they have 
met state standards. "^/^ ' 
This statement is misleading . Each participating local school district 
is free to establish its own learner objectives> its own instructional 
methods, and its owa evaliiation^ instruments . The evaluations at the 
kindergarten and grade one levels are In terms of local objectives which 
were accomplished. For grades two. through six, the evaluations are in terms 
of the goal, of one month gain for every month in the program.' 

Itfem: "If students haven't met standards, their 

district does not receive its allocation of 

32 • 

Chapter 3 funds." 

» 

; This is not true. For grades K-1, full payment is received if the students 
attain at least 15% of the local objectives. For grades 2-6, full payment 
is received if the students reach at least 75% of "the goal of one month's 
gain for each month in the prograirf. la cases where there Isuess than 75% 
success, the funds are pro-rated . 

\ \ ^ • . ^ ^• 

Districts cjtn recoup all or part of the unearned funds through the 

provisions of Section' 39a of the State Aid Act by providing a new delivery 

system to correct inadequacies in the programs which were not working well. 



^°Ibld., pp. 22-23. ^-" -Ibid ., p. 22. . ^^Ibid. 
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In, addition, l)a8ed upon .advice from the State Advisory Council for 
Compensatory Education, additional Chapter 3 changes have been approved by 
the Stat§ Board of Education. • ^ ' Jt 

Item: ^"Money may be awarded not on >true gain but on 
'test ^rror'."^^ . ^ ^ 
This is p erhaps true to a certain extent but there is no evidence to 
determine the severity of the problem— If Indeeid It Is a problem . While • 
a single ^udent's score does have a wide ertror band, 'there Is no district 

It 

In the Chapter 3 program which has only one. student.^ In fact, a minimum of 
30 students is required for participation in the program. Therefore, the 
issue of individual errors becomes moot, and the issue ^^len beconies>uIfHow " 
much error is there in group scores?" Or, what^are the chances, tjliat a. f ^ 
district would receive funds it did not deserve simply Because oi. test . 
errors? J , - - . 

The Depa?rtmerit agrees that th*»»is an issue which woiild benefit. 



from a controlled, rigorotis experiment and would welcom^Jthe panel *s > 
suggestions for addressing the issue. 

Item: . .the alterijatlve delivery systems; h§ive 
consisted of performance contracting../'?^ 
This is^ not true. In fact/ few— if any— Chapter 3 districts are using 
performance contracts'" . , . 

Even if the panel had not made so many errors in describing the 
Chapter 3 program, the basic issues would remain :| 

1) ' Is it proper to identify districts which have the 
greatest concentrations of .students with basic skill 
deficiencies? 



— " ^ 

^^Ibld. ^*Ibid., p. 23. , . 
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2) Is proper to allot extra funds to' districts 

. • f 

which have 'the greatest concentrations of. such students? 

. 3) Should the best, known instruments 'for Identifying . 

such academib deficiencies ^ be used? . * . * 

♦ .* . * • - 

4) Once funds are allotted, can proper evaltiations 

be conducted by the local districts? . * 

5) If the educational deficiencies are removed, 

does the justification for the funds disappear? ' . 

6) If a district cannot remediate the educational 
deficiencies with extra funds, should the funds' 
be ^continued ad infinitum anyway? 

These are not simple questions, and the Department does not have all of the 
answers. However, the panel repdrf is .not only negative Iq tone, but it S 
does not offer any concrete suggestion for Improving Michigan* s unique 
performance-based compensatory education px:ogram which is specif^ally designed 
to demonstrate that ^Jicfllgan^s children — ^regardlessrpf^^l^lle, family circum- 
stances, or geographical location — can Require basl^B^fhool skills for adult 
survival. ^ " 

* The Department is willing td^'irften to any suggestions and hopes 

they vlll be forthcoinjl^ng. However, the State Advisory Council f6r Compensatory 
Education Is of the opinion the proposed changes in Chapter 3 legislation 
address most of the concerns which have been expressed. \ 

SDMMARY ' ' ■ ' ^ s 

C ' 

As was stated la the opening pages, this doctiment^was intended to 
review the report An Assessment of the Ml^chigan Accountability gystem 



written by Dr. Bmest* Bouse, T>t. Wendell Rivers, and Df • Daniel Stufflebeam. 
The present document sought to deaonstrate- that the panel report contained 
errors of fact, was not- totally unbiased, and was not rigorous in its 
apprdach. Additional areas' of differences in approach to contemporary 
educational problems between the panel members and the Department havV been 
revealed by this rev;lew of the panel report. 

. In total, Drs* , House, > Rivers, and Stufflebe^ produced ^ report 
which had greats potential for positive suggestions for improving the 
educational accountability program but failed to completely i*ive up to 
its potential. 

• The panel, in- essense, made nine fecommendatfions: 

1) that the Department modify the claim that the • K ^ 
selected objiBctj^^ves are minimal and represent 

a statewide consensus, 

2) that the Department abandon its plans to 
publish a book of objectives for pair/ents,^ 

3) thft the Department abandon its practice of 
rewarding school districts for good test ^ 
performance of their disadvantaged students,. 

4) that the Department expand its activities in 

implementing step 5 of the accountability ' . ^ 

model, V 

5) - that the Department abandon every pupil - 
^ testing in the assessment program, ' 

6) that the Depai^tment validate its assessment 
tests with minority children, 

7) that the Department encourage development of 
locally developed objectives, 

.8) that the Department move the assessment program 
to matrix sampling (related to recommendation 5 
above), and 
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9> that the Department provide assistance and 

encouragement to local educators in the , ^ * 

implementation of the accountability model* 

To these recommendations, the Department replies are as follows: 

♦ • 

. 1) the Depar.tment disagrees and would suggest the 
/ ' panel members were confused as to the nature 

of mi ni ma l objectives and their derivation, but 
♦ the Department agrees much clarifying work needs 

to be done in this area; * • . 

2) the Department disagrees and still feels p^irents 
have ^ right to see the performance objectives 
but agrees that publication of the "hajidbook" 

•should proceed with caution; 
^ . ^ . ^ — ^ 

3) the Department agrees the Chapter 3 program 
design is not perfect and to that extent has 
•recommended changes in the program for. 1975-76 
based upon the advice of the State A4visory 
Council for Compensatory Education; 

0 

4) the Department agrees that step 5 of the 
accountability model needls to be developed, • 
but will be quite threatening if steps three 
and four ar^ not refined first; 

5) the Department agrees that; testing all pupils 
in all subject areas would lead to prohlb;Ltiye^ 
costs and has no Intention of doing so to the ' ^ 
extent that the State Board of Education haa 

. adopted a position statement on this issue; 

6) the Department disagrees and can document * 
that the present fourth and seventh grade 
assessment tests were adequately piloted with 
minority children; 



7) the Department agrees that locally developed 
learner objectives, are very important and will 
continue to assist locals school persomiel develop 
objectives; 

8) the Department agrees that matrix sampling would 
be an^ess^iftial ingredient in future assessment 
designs,. but the Department does not intend to 
move entirely away from individual tests in 
certain skill areas at least for the foreseeable 
future, and 



/ 
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* \ the Deparfaeflt agrees vlth tlxe xecomendafciQir fco: \\ \ , . ' 

providet Msistarice .to iocal V 
ImBlementatioit of tlie accountability njbdel axid " , ^ 

has already, taken steps, to iaplement *^thls * 
suggestiqnv 

In flinanary^. the MEA/NEA^ panel and the Departanent positions are 
not far apart, the Departoient staff agree with six of the reconanendations ^ - 
and aisagree with three of tliem. There Is jevery reason to expect t:hat 

continued Involvaaent of menbers of the professional education cotnaunlty 

• " .' , - . . - * - . ■ ' " 

^1 be of great ass istance jp the Department and lead to an Improved,* - 
workable^ reasonable accountability program for Michigan education to the 
extent that no basic disagreements should exist. 

' The staff commends the National Education Association for joining 

with the Michigan Education Aasociation In financing such a study. In 
effect, the study has done more to Jocus attention and understanding on 
what Is being attempted to Improve the'quallty of public education than 
could ever have been accomplished by yttlllzing oiily Department staff. 
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\ The. Michigan Accountability System 

. Tariel Reconmendation So > 1 

It* is recoamended that the Department of Education modify its claim that the 
performance pbjective$ being published are minimal and represent sjtatewide 
consensus of public school educators* 

^ Staff Response to Recommeridation No* I / 

From the beginning of the Michigan Department of Education's program to. develop 
student performance objectives in the vatipus subject areas^ the inten| has 
.always been to develop these objectives^as "minimal student expect^ndjis," When 
the initial 11 referent groups' and the 13 grade level commissions were appointed 
to develop the first drafts of the objectives, they were consistently instructed 
to think in terms, of minimal student objectives, and each group and every indi- 
vidual who was involved In the development of the objectives was given this same 
direction. The question always was, in essence, "In your opinion as an expert . 
in the field of mathematics, or science, or communication skills (or in any of 
the other curriculum areas), what do you think ^should be minimal expectancies for 
Hichigan students at the end of the third grade, sixth grade, and ninth gxadeV\ 

In this sense, a minimal student performance objective is taken to be. one that 
describes an essential skill, knowledge or understanding which is commonly 
taught at, or below, a specified instructional level anJ which should be mastered 
by n^aarly' all regulan pupils when taught byjneans of presently-known techniques. 
This definition emphasizes /that minimal performance objectives deal with 
essential learnings, with the present st«e of the teaching art, and with tfie 
pbssibility of near universal mastery, it further attempts to avoid dictating 
what the total curriculum should be in any given school district. 

The qiiestiSn arises, then, "How do we know that what has .been defined as minimal 
in these various area and at these various instructional levels are indeed 
'minimal'?" The answer to 'this question is that although many people who have 
had extensive experience in these areas have been called upon to provide their 
opinion as to what constitutes minimal skills, no one at this time can be certain 
of the minimal nature of these objectives until they have been applied to 
instruction in actual field situations. 

The Department has recently embarked upon a "field- testing" program, whereby 
teachers who volunteer will use the objectives with their students.*to validate 
theirappropriateness, utilizing needs assessment and Instructional delivery 
system analysis* In addition, the staff will contract for a survey to be under- 
taken to verify if, indeed, the various published objectives represent a state- 
wide consensus amon^ the education profession. 

Both of these approaches will provide data as to the appropriateness of the 
objectives and, further^ verify whether or not they can be considered "minimal " 
in nature ♦ and represent a consensus of Jbhe teaching profession . 
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Panel ReconMnendatloa M6> 2 

It is recommended that.tlie Department of Education abandon\lts plan to 
publish a handbook of objectives for parents. 

Staff Response td Recommendation Nb'> 2 

After the minimal student performance objedtives were developed, it was 
found that th^y were too voluminous^ to dpnvenlently p&ss put to the large 
numbers of people who were Interested Iti them— particularly parents. The 
per£prmai\ce objectives are being widely used throughout the colintry. The 
Migrant Directors haVe adopted the math objectives as th^ir mo^el of 
expectations on a national basis. 

Parents have always wanted to know what some reasonable exp^ctatloiis for 
their children were as they progress through the school system. Realizing 
that many parents., would be 'interested^ in reylewlng the state minimal 
student performance objectives, it was decided that ah abbreviated version 
of the 'objectives should be developed^. This abbreviated version is now in '--^ 
the process of development, and when it is available it will be issued as 
a handbook for parents^! It should be made clear that this handbook is not 
a "new". set of expectancies, but. is. simply the student performance pbjectlves 
that have been developed over the past several years in a form and tength 
appropriate for parents. The State Board of Education has set as one of 
its i2 goals the Involvement ojf parents in the educational process. Michigan 
law does not allow the state agency tp sell the objectives, and even if it 
did most parents would feel pr^rwhelmed receiving the unabridged sets. 

The staff has, for several years^ been testing the handbook concept it^ II 
pilot elementary, schools and will expand that f leldrtestlng to 30 schoo|. . 
districtia in 1974-75, before final publication. ' \ 

When. the handbook is Issued, it will Include an introduction deserlblng 
how schools might best put the objectives, to use. Parents are also advised 
as to the ni^ture o£ the word "minimal''^ as it is used in the objectives. 

■■ ' ■ ' • ■ • \ 

This action is consistent with two of the goals of Michigan education, those 
being the InvolvetHent of parents and citizens in the educational process at ^ 
every step along the way, and not just in voting additional millage, o r 
T*Pceiving a report card o f student progress . 
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■Pgnel RecdnMnehdatlon N6« S ' \ ^- • 

it is recpnmenaed that the Department abandon its practice of rewarding 
school districts for good t6&t perfolhnance of their disadvantaged students.- 

/ » ' ■ . • ■ _ ■ - - , • . . -. • . ■ ' . ' 

^taf f . Rgspohse to" Recbtmendatloix No. 3 

The recommendation represents a blatant disregard for the well-being of 
the many poor White, Black, Indian, and Chlcano pupils that are under-- 
achieving in public schools, ibe record of the public schools, lack of 
success with these children has been, well documented by James S. Coleman. 
Kenneth Clark, Miriam L. Goldberg, and others. 

The present St^te Compensatory Education Program, relates funding' to program 
success, or student learnlngi- and it is the first and perhapa the otily major 
compensatory'- education i>rogram in the country to document such success. The 
program 8 evaluation reports- speak for. thetaselves coscerriing pupil successes 
in reading and- computation. Based upon audited findings of, the 99,048 pupils 
pre- and post^tested in 1972-73, 59.3 percfen^^f the pupils achieved average' 
gains eqa*l to .75 months for each month of the program;, and. more importantly', 
34.5 percent of the pupils achieved gains equal to or- greater than one month 
for each month in the program. ' 

Pupil gains were measured primarily by locally-designated ^f^ndardized norm- 
referenced tests in grades 2-6. Crlterfon-referenced tests tiere used to 
■ZSi^'^T^^^ achievement -lA grades K:l. Otiis is the record of a performance- 
baaed program that has been labeled whimsical by the three »'experts." Such 
success cannot be dismissed on the basis of the conment, ». . . standardized 
achievement tests are not good 'measures of what is taught in school." If 
that is a valid argument, then it'i highly questionable any test, particularly 
teacher-niade tests, should be given In any schools. T 

It shotiid be iioted'that State Ass essment is not used to measure prog ram 
success^ Each local district selects its own test Instruments to meas ure 
such success. In additi on, the 'State Board has adopted several chan ges in 
the Compensatory Education legislation which, according to the State Adv isory 
Council for Compensatory Education, should further strengthen the program . 
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. • The Michigan Acconntablllty. System 
- Panel Recommendation No. 4 « » . * 

^ ' * *' ' • - " - . ■ ' /. . ' ' - 

. It iB recownended that the Department expand its activities in Inqjle- 

/ \v menting Step 5 of the Accountability Model. j ^ 

. ; . Staff Response to Recotamendation No.. 4 , • ' ^ 

The 35'^rtment of Education is, committed to evaltiation development and 
ei^ansion and, in fact, in the past four years has greatly expanded 
activitfes in eiraluation. Currently, seven programs of the Department 
are being evaluated. These evaluation activities cover, nearly 1,100 
projects in over 500 school districts. . ' 

' Additionally, technical assistance in evaluation is available to state 
' * and local .educators in the form of consultation and workshops. Annually 
3,0 or more workshops are conducted throughout the st^kte for local 
/ education agency sta^f. Evaluation of delivery system effectiveness, 

; however ;^ is dependent upon (1) developing expectations, (2) identifying 

. - stud^t needs, and (3) analyzing what is bein^ done. As more tod more 

local education agencies develop performance objectives, needs assessment , 
and delivery system analysis, and more and more state and federal programs 
do the same, evaltiatlon should follow.^ 

The Department of Education concurs with this Panel recommendatipn to 
expand its evaluation activities. Indeed, expansion in this i&ea h^s 
been rapid (both in* terms of quantity and quality) and plans for ad- 
ditional expansion are. being developed, but must proceed consistent 
/ ; / with the interest, capabilities, and local needs which presently ar^ 

^ focused upon spelling out what is expected, what is needed, and how to 
1 go about providing the service. Without such carieful development, the 

: evaluation cbn?)onent could become extremely threatening as demonstrated 

\ - in the recent Detroit seven- week , teacher s' strJ^ei 



The staff is curr^intlv conducting it survey of local an d Intermediate 
school district resources and capaiilities in evalu ation.- Based on the 
results of this survey /which will be nUide public l ater this year, more 
adequate services will be planned and designed to pro vide the expansion 
of activities associated with Step 5 of the Accountability Model. 
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Panel Ttecbamehdatlon No 5 ' 

It reconineiided that the Department abandon every pupil testing in 
, :the assessment progxram^ \ 

Staff Response to Recommendktibn No> 5 ' • 

' • - . ' ' -<^ ' 

This recoBineiidatipn of the Panel is based on sheer conjecture — no rigorous 
attempt was made to determine the extent to' which ;de^5l8ions are being 
affected by either the asscs&inent component or jthe overall accountability 
program* The Department has not conducted research in this area either, 
but thetfe is evidence to suggest that tlie assessment data are being 
utilized and have affected legislation (e.g... Chapter 3 of the State . 
Aid Bill), 'judicial decisions (e.g., miiten and Kelley vs Green> et al) , 
•and local school disjtrict planning. However since the issue has been 
ralsedt definitive data on the extent of local district usage is currently 
being sought through a surv^ of school superintendents, and will be reported 
publicly this sunmier*. 

The ^ost of t|ij^^prpgram as it is preseiitly structured is almost inconsle- 
quential for the results obtained ^ The tests, on the ayerage, require 
about five hours of administration time p6r year for 4th and 7th graders — 
that's 5 hours for diagnosis out of a minimum of 900 hours of instruction. 
The financial cost of testing ail of the. state's 4th and 7th graders .is 
only about 75 cents per pupll^ well wlttxin the range of commercial test 
publishers. That's- 75 cents out of an avetage instructional' cost of 
$1000.00 per student. Fdr this investment, the local teacher receives 
I highly specific information on each 4tli.and 7th grade student's attainment 
in reading and mathematics; the school and district recieves aggregate 
summaries; the parent obtains a guide as to his or her child's progress in 
the basic skills,; and the state receives data for' statewide, decision- 
makings 

The Department is of the firm conviction that in selected subject fields, 
at selected intervals in the education process, the stat^ should require, 
an assessment of progress on every student • Other state assessment ^^hould 
be by sampling. Beyond that, it should be the responsibility of the\^ 
local dlstri^ct to deterteiiie whether student needs are being made, grade- 
by-grade and subiect-by-Subject. 

The State Board of Education will be requested to encourage local boards 
of education to develop compatible and comprehensive local assessment 
^ T^rograms w 
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Panel Recommendation No» 6 ; j • ^ 

It Is recommended that the Department validate Its assessment tests 
with minority children. j 

Staff Response' to Recommendation No. 6 

The specific charge was levied that "no evidence was available that the 
items comprising the reading test had been tested or validated" with 
such children. . ^ 

This is* not .an accurate .observation. The tests used in the 1973-74 
assessment program were developed in five Michigan distrl<!ta, including 
Jackson and Pontlac. Ih addition to pretesting lii these original five 
districts, all eight regions of the Detroit Public Schools voluntarily 
participated in the pretests of the instruments. Thus, if anything^ 
children. from low socioeconomic levels and minority children were over- 
represented in thie field tests. 

A more basic issue is whether it would be proper to develop a test 
specifically designed for minority group children. Such a test could 
undoubtedly be developed and, in fact, children from majority groups 
would probably hot do well oh it. 

The staff believes. the evidence is overwhelming that the present state 
assessment is not biased unduly against minority children, and would 
offer to survey appropriate persons on the issue of test bias. 

The Michigan Department of Education takes the position that there is 
no Inherent reason why minority group children cannot learn as well as 
other children. The purpose of the assessment tests is to distinguish 
between those phiidren, regardless of polor who have attained certalh ^ 
reading and mathematics skills and those who have not so that appro- 
priate compensating instruction can be provided. If the testa do not 
discriminate in this manner, no compensating assistance can be provided 

The Department is aware of a recent survey conducted by the Michigan 
Education Association which will confirm the staff tx)Sition that the 
instrutnent was not viewed as bias by 4th and 7th grade teachers. 



.Footnote: A Survey of Views Concerning Michigan's 4th Grade Assessment 
Program, 1973-74. Michigan Education Association - 74-R-26. 
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Aa. Asseagiaent of 
^ The Mlchigail Accountability System 



Paoel. Recomneridatiotf ISo. l ' 

:i^e: ii x^to^ the Departinent Encourage locaily developed 

Staff fesponse ta Recotanendatlon N6« 7 

The <:ha:rge is made that the state miidmAl objectivej? have perverted and 
threatened local district curricula. /* 

This threat is quite of teri heard by opponents of the State Accountability 
Modfi «l4 ^t^i accionq>anying subsystem*. Charges of "statue control'^ are 
alWiys easy to hurl,' difficult to defend against, iidlimposs'ible to prove. 

Ihe ktchi^an Departmen no intention of dictating the 

curriqjutiii local school district^ beqause indeed each district 

do^s. serve differewt clienteles. However, fhere fs evidence to believe 
tha;t all local dlstrijcts are not nov guaranteeing that even minimal 
reading mid mat^^^ to nearly all students. 

The state, ^a^ the legal responsibility of prgViding a basic education 
Co all cit;ia;ens regardless of whisre they liv^, go to school, or their 
faml,ly circimstances. To achieve this end, the Department is encouraging 
the definition of a set of minimal skill objectives which shduld be . 
attained by children in all schools. The assessment progrsia is con- 
jitruc ted around these objectives. 

The i>spartment agrees^ however, that every local school district should 
supplement the state minimal bSlectives and always stands re^ady to 
assist locial districts In their development. Each local school board 
shbuld require objectives for each subject taught, and possibly the 
State Boiard of Educiatioh will be requested to communicate this to 
local boards o¥ (education! ^ ' 7"^ 
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The Michigan Accountability System 



An Assessment of 




panel Recommendation No^ 8 



It is irecommended that the Department move the assessment program to matriit 
sampling (related to recommendation 5)# 



Staff Response to Recommendation Nb# 8 



The panel evidently feels that the present assessment program which te#ts 
every 4th and 7th grade pupil should be restricted to provide only statewide 
data. Ihis restriction would not provide individual pupil information usable 
by classroom teachers for instructional planning purposes. Yet^ a recent 
survey of fourth grade teachers conducted by the MEA indicates a majority 
of teachers, desire pupil level information. 

The Department agrees in jJart with the Panel in that matrix sampling woul4 
be a useful technique to provide data on ^ statewide basis on^certain 
learner objectives. This is reflected in the as^sessment program (draft) 

^long-range plan currently being developed with the assistance of Dr. 

"jrank Womer, University of Michigan, who is a nationally known expert on 
actiievemeut testing and one of the "fathers" of the National Assessment of 
Educational Progress. ^ ' * 

It is obvious that the assessment program could not test in the future every 
pupil on all objectives la each subject area because the tests would be 
ridiculously long. Instead, the State Board of Education has adopted the 

' policy that each student be tested only on a core of highly important > 
minimal objectives in reading, mathematics^ and selected other areas, and 
that further data on other objecfcives be collected by matrix sampling 

- methods . The Department believes that this approach is desirable because 
it win encourage local educators to focus oh each student's attainment. of 
basic reading and mathematics skills, and jseveral other possible areas of 
universal Importance^ such as physical fitness or health, while leaving to 
local initiative the deteifmlhatlon of the total curriculum based on local 
needs. * . . ♦ ' 

;]rtie Department agrees that it is desirable to assist local educators to 
develop their own assessment measures and has already undertaken a 
comprehensive program to carry out this task which will undoubtedly lead 
to a proposed statewide funding program of inservlce training of staff . 
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An A ssessment of * * - 

'» / — • 

• The Mijchlsan Accoqat ability System 

• • • «• ♦ ' ♦ , 

Panel Recommendation No, 9 ' *. 

It Is i-ecommended that the' Departmeit provide assistance and encouragement to 

local educators In the Implementation of the Accountability Mod^l. ' ' ' 

- / ■ . • " \ 

staff Response to Reconimendatlon No*. 9 * , - ^ * 

— — • • ' • ■ . r- 

The Depairtment is keenly aware of the need to provide assistance to individual 

schools and school district staffs who want to implement an accountability* 

approach to improve their servipeS to childrerv fd meet this need several 

actions have been initiated oVer.the years. \ , 

First, ^the Department sponsored, a pilot program with eleven elementary schools, ^ 
six secondary schools and an intermediate school' district' to determine the kinds 
of problems individual schools would have in implementing the six-step Account- 
ability. Model. Department staff is working closely with the principals, 
teachers and central' oiEf ice adininistrators as they implement each'ste^ of the 
Accountability Model. The schools are in various', stages of complet;l.on, and 
when they, accomplish .all steps of the model they will serve as demonstration 
sites for others who want to Implement a system program Improvement through ■ * 
the. six-step model. • . 

' - • ■*.»_, ■ ' 

Second, for the past four years school districts have been applying for ^competi- 
tive grants under ESEA Title III,, and in presenting their proposals they must 
utilize the six-step Accountability Model. During this time over sixty school ' * 

districts have been engaged in the six-step accountability procedures through 
ESEA Title m grants. Department staff provided the necessary technical 
assistance to each of the participants in an effort to help them use the model 
effectively. - - , . .. 

The Department staff has provided numerous workshops in local and intermediate' 

school districts In an effort to provide technical, assistance to those school 

districts who want and need such help. It should be noted, however, that this • - 

effort is Impeded because of the magnitude of the demand, and the limitation of 

the number of Department staff. Hopefully, as more sup.erin^eridents, principals ~ ' 

an<| teachers learn to liiq>lement: the model effectively, they wilt be able ^o ~ 

serve others in acquiring this skill. Judt as important is the need to tap the ' / 

college staffs to assist in this endeavor. \ 

' ' ■ - ' **" ' \ ' 

Finally, the Michigan Association of Elementary SchdJal Principals and the Mich^ 
Igan Association pf Secondary School Principals Jiave requested assistance for \ 
their memberships in utilizing the Model, and Such training ^sessions are being 
jointly planned. - 

The Department of Education stands ready to be of greater assistance in expanding - 
on a voluntary basis, the uniaua training c o mponents of the Accountability Model. 
which have been undervAv for foflr years, and welcomes suggestions on how t:ht « can 
best be accomplished^ / ~ ' ' \ " 
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